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We introduce a multipartite extension of an information-theoretic distance first introduced in 
[Nature 341, 119 (1989)]. We use this new distance to derive entropic tests of multipartite nonlo¬ 
cality for three and for an arbitrary even number of qubits as well as a test of state-independent 
contextuality. In addition, we re-derive the tripartite Mermin inequality and a state-independent 
non-contextuality inequality by Cabello [Phys. Rev. Lett. 101, 210401 (2008)]. This suggests 
that the information-theoretic distance approach to multipartite nonlocality and state-independent 
contextuality can provide a more general treatment of nonclassical correlations than the orthodox 
approach based on correlation functions. 
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Introduction. In classical information theory if some 
binary property A is correlated with B', B' with A' and 
A' with B then A must be correlated with B. This is 
not necessarily true in non-classical information theories 
where correlations can be non-transitive. For instance, 
A can be anti-correlated with B [T] (see Fig. [^. If one 
looks only at the outcomes of random variables, the clas¬ 
sical and nonclassical scenarios are dramatically differ¬ 
ent, however from the entropic point of view they do not 
differ at all [2]. More precisely, the Shannon entropies 
H{A), H{B) and H{AB), where H{A) = - Ea = 
a) log 2 P{A = a), are the same regardless of whether the 
system is classical or not. 

In order to detect nonclassicality via entropic test one 
has to look for other types of nonclassical correlations 
(see Fig. [^b right). These can be found by either look¬ 
ing for a different set of measurements [3], or by a post¬ 
processing of a measured data, e.g., mixing of nonclassi¬ 
cal and classical distributions [2]. 

The entropic tests of the bipartite nonlocality were in¬ 
troduced in the late 80s [3]. Recently, these tests were 
extended to include the state-dependent contextuality 01 - 
[6] , which is a more general concept than nonlocality since 
it studies nonclassical correlations in systems that are not 
necessarily spatially separated. However, the entropic 
approach to the multipartite nonlocality and to the state- 
independent contextuality has not been proposed before. 

We use the previously developed information-theoretic 
distance approach to nonclassical correlations cm and 
propose a new multipartite distance that can be applied 
to binary ±1 measurements. This distance quantifies 
multipartite correlations in terms of Shannon entropy 
and we apply it to derive an entropic tripartite inequality. 
The structure of this inequality resembles the tripartite 
Mermin inequality uni- Next, we derive an entropic mul¬ 
tipartite inequality to test the multipartite nonlocality of 
an arbitrary even number of qubits. Finally, we derive an 
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FIG. 1: Bipartite correlations between two observers. Each 

local measurement 

is maximally random, i 

i.e., P{A = 1) = 


P{A = —1) = 1/2, etc. Classical correlations (a) are tran¬ 
sitive, namely if A = B', B' — A' and A' = B, then 
A — B. However, nonclassical correlations can be non tran¬ 
sitive giving A — —B {h left), or no correlations H{AB) = 
H{A) + H{B) {h right). Such extreme nonclassical bipartite 
correlations cannot be observed between quantum systems. 


entropic inequality to test the state-independent contex¬ 
tuality, which resembles the correlation-based inequality 
by Cabello m- All these inequalities are satisfied by 
correlations for which the information-theoretic distance 
can be properly defined. This is true for local realistic 
and non-contextual systems, but is violated by measure¬ 
ments on quantum systems. 

Multipartite distance. The entropy-based information- 
theoretic distance was originally proposed by Zurek [12] . 
The essence of distance is to measure how far two points 
are. Points can be represented by coordinates in a Carte- 
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sian space or by a more abstract objects such as func¬ 
tions or operators. In the information-theoretic frame¬ 
work these objects are two random variables - in our 
case, two jointly measurable observables. One of the ob¬ 
vious questions to ask is whether it is possible to ex¬ 
tend the notion of distance to more than two points. 
Here, we show that this can be done if points are rep¬ 
resented by binary, jointly measurable random variables, 
however, there are other ways to propose the multipartite 
information-theoretic distance (see for example [l3]). 

Let us first consider the following function defined for 
binary observables A and B 

d{A,B) = H{A-B), ( 1 ) 

The measurement of A’ B is one where the outcomes are 
the product ab. 

The function in Eq. 0 satisfies all of the distance prop¬ 
erties. It is (i) non-negative^ d (H, B) > 0, because 
H {X) >0 and it equals to zero only if A = B, in which 
case the outcome of the measurement is always one (ii) 
symmetrie d{A,B) = d{B,A) (hi) it obeys triangle in¬ 
equality H{A^B)<H{B-C)^H{A^C). 

The triangle inequality is satisfied because 

H {A ' B\A ’ C^B ’ C) = 0 , i.e. if the outcomes 

of the two measurements A • C and B • C are 
known, then the outcome of H H is the product 
of the two outcomes and is therefore known. More 
precisely, H{A^B) < H {A - B, B - C, A - C) = 
H{A^B\A^C,B^C) A H{B^C,A^C) 
h{b ’ C, A’C) < H{B’C) A H {A’C). We used 

H{AB) = H{A\B) + H{B), H{AB) < H{A) + H{B) 
and H{A) < H{AB). 

The distance in Eq. 0 can be extended to multipar¬ 
tite measurements. Note, that for a set of binary ±1 
variables {Hi, H 2 ,..., A^} one can define 

6 (Hi, H 2 ,..., An) = H (Hi • H 2 • ... • An ), (2) 

which is the natural extension of the distance for two 
variables. 

The function 6 is obviously non-negative and symmet¬ 
ric, but it also has a nice associative property 

6 (Hi,..., H/c, H/c+i,..., An) = 

6 ((Hi •... • Ak ), (H/c+i • ... • H^)). (3) 

Note that using the symmetry property, any two H^ could 
be associated. Moreover, the associativity also implies 
that 6 obeys the following version of the triangle inequal¬ 
ity 

^ (-^ 1 : • • • 5 • • • 5 ^n) ~ 

6 ((Hi • . . . • H/c), (H/c+i • . . . • H^)) < 

J((Hi.....Hfe).(Hi.....H^)) + 

S {{Bi • ... • Bm) • {Af^_^i •... • H^)) = 

^ (-^ 1 : • • • 5 ^k") -^ 15 • • • : ^m) T 

^ (-^l5 • • • 5 -^7715 ^/c + l5 • • • 5 ^n) • (4) 
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FIG. 2: Tripartite correlations between three observers. Each 
local measurement is maximally random, i.e., P(H = 1) = 
P(H = —1) = 1/2, etc. Classical correlations (a) imply that 
if AB'C' = A'BC' = A'B'C = 1, then ABC = 1. However, 
for nonclassical tripartite correlations (b left) one can observe 
ABC = —1 (GHZ paradox). The above nonclassical cor¬ 
relations are entropically indistinguishable from the classical 
ones, however one can also observe no tripartite correlations 
between H, B and C {h right). These can be detected via en- 
tropic inequalities, since the product of the three observables 
has maximal entropy H(A-B-C) = 1. In contrast to bipartite 
scenario, such extreme nonclassical tripartite correlations can 
be observed between quantum systems. 


We would like to remark that multipartite information 
diastance has been considered before. In Ref. [13] Vi- 
tanyi considered the following quantity 

-E’max(X) = max I a;), (5) 

x£X 

where X is a set, x are its elements and K stands for 
Kolmogorov complexity. However, Pmax(X) with K re¬ 
placed by Shannon entropy H cannot be used to detect 
the difference between classical and nonclassical correla¬ 
tions. This motivated us to look for Eq. 0. 

Tripartite information-theoretie Bell inequality. Let us 
examine the properties of 0 in the context of tripartite 
measurements. We derive the following inequality: 

<5 (^ 1 , Bi,Cl) <d{Ai, {B2.C2)) + d((B 2 .C 2 ), (Bi.Ci)) 
= d(Ai,B2.C2)+<^(S2,Ci,Bi,C2) 

< (5 (Ai, B2, C2) + d (A2, B2 • Cl) + d (A2, Bi • C2) 

= (5 (Ai, B 2 , C 2 ) + (5 (A 2 , B 2 , Cl) + (5 (A 2 , Bi, C 2 ). (6) 

where Aj, Bj and Ck = 1 , 2 ) are measurements of 

Alice, Bob and Charlie, respectively. 

The inequality 0 was derived using the classical prop¬ 
erties of Shannon entropy, therefore it must hold in any 
theory that obeys them. In particular, in local realis¬ 
tic theories there exists a joint probability distribution 
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for all observables Ai,..., C 2 m and as a consequence 
there exists a joint entropy H{Ai •... • C 2 ) which implies 
the validity of §• However, one may expect the viola¬ 
tion of this inequality in a nonclassical theory (see Fig. 

©■ 

Let us consider a three-qubit system in the 
Greenberger-Horne-Zeilinger (GHZ) state \GHZ) = 
^(|000) -t- I 111)) shared between Alice, Bob and Char¬ 
lie. Each of them performs one of the two possible lo¬ 
cal ±1 measurements on their subsystem: Ai, A 2 , Hi,... 
As previously discussed, we can choose 6 {Ai, Bj^Ck) = 
H{Ai G) Bj (g) Ck) (for i, j, /c = 1, 2) and plug these mea¬ 
surements to the inequality (§ to obtain 


triangle inequality of to obtain 


H (^1 ®Bi®Ci)<H (^1 0 ^2 O C 2 ) 
H {A 2 0 0 C 2 ) + i? {A 2 0 B 2 0 Cl). 


Quantum theory violates the inequality 0 if Alice, 
Bob and Charlie chose 

Ai = Bi = Cl = cos (I) X + sin (^ Y, 


where X and Y are Pauli operators, 
have H (Ai (g) H 2 (g) C 2 ) = H (A 2 (g) Hi (g) C 

H {A 2 (g) H 2 (g) Gi) = 0, but at the sam( 

H (Ai (g) Hi (g) Gi) = 1. This achieves maximal al¬ 
gebraic violation of 0 . 

Note that the derivation of 0 holds not only for the 
entropic function S, but for any distance with the asso¬ 
ciativity property. For instance, applying the generalisa¬ 
tion of the co-variance distance [HI [ 9 ], 6 {Ai^A 2 ,As) — 
1 — {Ai • A 2 • A 3 ) to ^ gives the original tripartite Mer- 
min inequality m 


{Ai ■ B2 ■ C2) + (^2 

- {Ai-Bi-Ci)<2. 


Bi ■ C2) + (^2 • B2 ■ Cl) 


(9) 


Multipartite information-theoretic Bell inequality. One 
way to extend the previous result to more than three 
parties is to follow the approach proposed in na, where 
it was shown that the genuine multipartite nonlocality 
without inequalities, the so called Greenberger-Horne- 
Zeilinger (GHZ) paradox [16], can be obtained if one al¬ 
lows for more than two measurements per observer. We 
will focus on the even number of qubits, which requires 
three measurements per observer. However this reason¬ 
ing should be applicable to the odd number of qubits as 
well, perhaps with the need for more than three local 
measurements [15] . 

Let us consider an even number N of observers shar¬ 
ing a multipartite system. Each observer measures three 
randomly chosen binary ±1 observables where 

i = 1,2,3 labels measurements and j = 1,..., A" labels 
observers. We use the associativity, symmetry and the 
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( 10 ) 


The term on the left hand side contains only measure¬ 
ments m[^\ whereas the first N terms on the right are 
cyclic permutations of one measurement m[^\ one mea- 

fj\ rj\ 

surement ^ and N — 2 measurements M 3 L The re- 
(7) maining term on the right contains only measurements 


The derivation is as follows. We start with the mul- 
tipartite distance , Aff ^^,..., ) 

and apply the triangle inequality (together with symme¬ 
try and associativity) to obtain 


( 8 ) 



Mf)) < 

We 



Mf)) + 

= 



,...,Mfy (11) 


The term on the left and the first term on the right hand 
side correspond to measurable quantities in the inequality 


( 10 ), whereas the second term on the right cannot be 


experimentally verified. Therefore, we repeat the same 
procedure as before and expand the last term as 


,M 


(5(Mf ^,..., , Mf ^^ 

, Mf), Mf) ) + 


(N), 


3 ) — 


\ Mf \ Mf y (12) 


Again, we generated a term that is observable and an 
additional term that requires further application of the 
triangle inequality. One can easily notice the following 
pattern. After k repetitions of the above procedure one 
generates the measurable term 

(5(Mf \ ..., ..., 

(13) 

and the non-measurable term of the form 

(5(m('=+') ,..., , Mf \ ..., Mf+'), \ , 

(14) 

if k is odd, or 

^(^(fe+i) ^ ^ ) 

(15) 

if k is even. Finally, after k = N — 1 repetitions (we 
remember that N is even) we obtain almost all the right 
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hand side terms of (10), except the last two, and an addi¬ 
tional non-measurable term. This term can be expanded 
into two missing measurable ones 


Mf, Mf,..., M^) + 

Mf), Mf), ,..., ), (16) 


which ends the derivation. 

The above inequality can be maximally vio¬ 
lated in quantum mechanics by the A/'-partite 
GHZ state \GHZ)n = (|0...0) + |1...1))/V2 

and for S{m[^\ m[^\ m[^\ m[‘^\ ..., 

0 Mf ^ 0 


0 etc. In this 

(i) _ 


case 


the local measurements are = cosa^X + sina^T, 

where (ai = <^2 = 0 and 0^3 = ~ o/vr v-9^ • The choice 


2 N^ ~ ^ ~ 2 N(N- 2 ) 

of the angles stems from the following observation 


0 ... 0 m. 


(iV)' 


|0...0) + |l...l) 


/ 2 
g-i(ai + ...+a0 |Q . . . 0) + ed«. + --+«i) |1 ... 1 ) 


(17) 


= \GHZ) 


N, 


where the overlap {GHZ\GHZ)n = cos{ai -h ... + aj). 
In every case, except <Z m[‘^^ <Z ... 0 the 

overlap is one and the corresponding entropy is zero. On 
the other hand, the entropy on the left hand side of ( [1Q| ) 
is one because the overlap is zero. 

Information-theoretic state-independent contextuality. 
Contextuality is a form of nonclassicality that is more 
general than nonlocality. In this case a spatial separa¬ 
tion of measurements is not necessary and all of them 
can be performed on a single localised system. The cru¬ 
cial assumption is based on a classical intuition that the 
outcome of one measurement does not depend on what 
other compatible (non-disturbing) measurement is per¬ 
formed at the same time. This assumption is known as 
non-contextuality and systems violating it are called con¬ 
textual. Interestingly, in quantum theory contextuality 
can be exhibited by any state of the system with the di¬ 
mension larger than two, whereas nonclassicality in non¬ 
local scenarios can be exhibited only by entangled states. 

We will now consider an entropic version of the 
state-independent contextuality proof commonly 
known as Peres-Mermin square [HHini- Consider 
nine ±1 observables that can be measured on a single 
system. Due to compatibility relations these mea¬ 
surements can be performed in the following triples: 
{A, a, a}, {B, b, /?}, {C, c, 7 }, {A, B, G}, {a, b, c}, {a, 4 7 }- 
The classical reasoning, based on the non-contextuality 
assumption and on the assumption that outcomes 
exist prior measurements, implies that for measurable 
products qi = A • a • q 2 = B • b • (3, q^ = G ’ c ’ 
q 4 ^ = A • B • G^ q^ = a • b • and q^ = a • ^ ^ one has 
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FIG. 3: Tripartite correlations between local observables con¬ 
stituting the Peres-Mermin square [ims]. Classical correla¬ 
tions (a) imply that {Aaa){Bb^){Cc'^){ABC){abc){a^^) = 1 . 
However, for nonclassical contextual correlations {h left) the 
product can give —1, for example 0/^7 = — 1. In quantum 
mechanics one can find such non contextual observables for 
which these nonclassical correlations do not depend on a state 
of a system. They are entropically indistinguishable from clas¬ 
sical ones, however, after mixing them with the classical ones 
one obtains a distribution that can be detected by entropic 
inequalities {h right) since H{a • — 1 


However, in nonclassical theories one can observe that 
11^=1 Tig. 1^. In quantum theory this is 

achieved by a set of two-qubit measurements M = X (g) 1 , 
a = ]1(8)X, a = X(g)X, B = ]l(g)T, a = T(g)]l,/3 = T(g)T, 

G = X Z)Y ^ c = Y (Z X ^ j = Z Z ^ where X, Y and Z 
are Pauli operators inHini. 

Next, we use the associativity, symmetry and the tri¬ 
angle inequality to derive: 

<5(a, /3, 7 ) < HA a, a) + S{A, a, j3, 7 ) < (18) 

S{A, a, a) + 5{B, b, j3) + 5{A, a, B, b, 7 ) < 

S{A, a, a) + 5{B, b, /?) + 5{A, B, C) + S{G, a, b, 7 ) < 

S{A, a, a) + i5(i?, 6 , j3) + i5(H, B, C) + S{a, b, c) + S{C, c, 7 ). 

The corresponding entropic inequality is of the form 

H{a • /3 • 7 ) < H{A • a • a) - 1 - H{B ^ b • f3) 

+ H{A^ B ^G)YH{a’b-c)^H{G -c-j). (19) 


For the above quantum observables on a localised two- 
qubit system one finds that = ^2 = * * * = ^5 = 1 
and qQ = —1 for any quantum state. This distribution of 
outcomes does not violate the inequality (19), however 
if we follow the method of Ref. [2] and equally mix it 
with the classical distribution qi = • • • = qQ = 1 we get a 
distribution allowing for the maximal violation (see Fig. 
I^b right). 
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As in the case of the multipartite nonlocality, the 


derivation of (18) holds not only for the function 5^ but 
for any distance with the associativity property. Apply¬ 
ing S (Ai, A 2 , A 3 ) = 1 — (Ai • A 2 • A 3 ) to the inequality 
( p! 8 | ) gives the non-contextuality inequality by Cabello 
|llj . which is violated by any quantum state 

(A • a • a) - 1 - (5 • 6 • /3) + (A . 5 • C) 

+ (a • 6 • c) + (C • c • 7 ) — (a • /3 • 7 ) < 4. (20) 


Discussion. We have derived entropic inequal¬ 
ities to test the multipartite nonlocality and the 
state-independent contextuality using the multipartite 
information-theoretic distance and a finite number of 
measurements. In both cases, quantum mechanics allows 
for maximal violation of these inequalities, which corre¬ 
sponds to the maximal nonclassical behaviour detectable 
by such a test. On the other hand, the bipartite quantum 
nonlocality was unable to maximally violate entropic in¬ 
equalities based on a finite number of measurements [3]. 
This brings us to an interesting analogy. It was shown 
(see for example m) that correlation-based Bell inequal¬ 
ities admit maximal quantum violation only in the case 
of multipartite systems. Here we show that the same is 
true for multipartite entropic Bell inequalities. 

Another important observation is the fact that for the 
multipartite nonlocality we were able to find a state and 
measurements leading to a direct violation, whereas in 
the case of the state-independent contextuality we had to 
mix the measured nonclassical data with a classical prob¬ 
ability distribution in order to observe the violation. We 
attribute this to the state-independence property. The 
state-independent contextuality is a property of measure¬ 
ments, not the property of states. In order to obtain a 
direct violation of an entropic inequality one would have 
to look for a product of some observables for which the 
entropy in any state is larger than entropies of other prod¬ 
ucts. Although we do not provide a proof, we speculate 
that such observables do not exist. 

We also re-derived two known inequalities. This sug¬ 
gests that the multipartite information-theoretic distance 
approach is a more general treatment of multipartite non¬ 
classical correlations than the standard approach with 
correlation functions. Note, that this idea has been al¬ 
ready proposed for bipartite nonclassical correlations [ 8 ] . 
However, to fully prove it one needs to show that all mul¬ 


tipartite Bell inequalities and non-contextuality inequal¬ 
ities can be derived from some multipartite distance. 

There are several open problems that require further 
investigation: (i) extension to nonlocality of an odd 
number of qubits (ii) finding an information-theoretic 
distance suitable to investigate multipartite nonlocal¬ 
ity of higher dimensional quantum systems (hi) derive 
multipartite monogamy relations from the properties of 
information-theoretic distances, perhaps using ideas in 
0 . 
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